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PREFACE 


This  report  documents  the  second  in  a  series  of  Federal  Aviation 
Administration  controller  evciluations  of  en  route  air  traffic  control 
services  pleinned  for  inplementation  on  the  Data  Link  system.  Hie  report 
is  organized  in  two  volumes. 

Volume  I  contains  the  main  body  of  the  r^»rt.  It  includes  a  detailed 
description  of  the  objectives  of  the  study  and  of  the  technical  approach 
and  test  methods  that  were  used.  In  eidditicai,  the  combined  results  of  the 
stuc^,  conclusions,  and  reocmmendations  are  presented. 

Volume  II  consists  of  a  set  of  four  ^pendixes  to  the  report.  These 
appendixes  are  referenced  in  Volume  I  and  include  documentation  of  the 
controller  procedures  used  to  deliver  the  test  services,  as  well  as 
detailed  analyses  of  the  data  that  were  collected. 


iii 


ACKNC3WIEDGEMENTS 


Hie  study  reported  in  this  document  vras  conducted  at  the  Federal  Aviation 
Administration  (FAA)  Techniceil  Center  under  the  direction  of  Nicholas 
Talotta,  Technical  Program  Manager,  Airborne  Collision  Avoidance  and  Data 
Link  Systems  Branch,  ACD-320. 

The  planning  and  execution  of  the  study  were  the  results  of  cooperative 
efforts  of  several  members  of  the  Data  Link  Develcpnent  Team.  In 
particular,  the  following  individuals  played  key  roles  in  this  research: 

Nicholas  Talotta,  FAA  Technical  Center  -  Test  Director 

Thonas  Pagano,  FAA  Technical  Center  -  Test  Coordinator 

Haim  Gabrieli  -  MITRE  Coordinator 

Henry  Marek,  FAA  Technical  Center  -  Test  Documentation 

William  VanCampen,  METRE  -  Scenario/Script  Coordinator 

George  Chandler,  FAA  Technical  Center  -  Data  Link  Pilot/VAX  Coordinator 

Clark  Shingledecker,  NIT,  Inc.  -  Human  Factors  Coordinator 

Daniel  Kashey,  Data  Transfonration  Corporation  (DTC)  -  Host  Carrputer 
System  Softvrare  Design 

Appreciation  is  extended  to  the  members  of  the  Data  Link  Development  Team 
including: 

James  Merel,  DIC 

John  Evans,  DTC 

David  Sweeney,  MITRE 

Thonas  Zurinskas,  FAA  Technical  Center 

F.  Paul  Zito,  FAA  Technical  Center 

Karol  Kerns,  MITRE 

Preston  Cratch,  METRE 

Appreciation  is  also  extended  to  the  staff  of  the  Technical  Facilities 
Division,  ACN-300,  who  provided  the  expertise  required  to  keep  the  many 
NAS  test  systems  cperating  in  order  to  prepare  and  conduct  these  tests. 

This  report  is  the  product  of  inputs  submitted  by  the  FAA  Technical 
Center;  NTT,  Inc.;  eind  The  METRE  Corporation. 


V 


Special  c^reciation  is  extended  to  the  nine  air  traffic  controllers  v4io 
served  eis  subjects  euid  observers.  Without  the  professional  and  thouj^tful 
contributions  of  the  following  individuals,  this  study  would  not  have  been 
possible: 

Roraiie  L.  Uhlenhaker 

Plans  and  Programs  Specialist  and  D/FW  Metrcplex  Air  Traffic 
System  Program  Manager 
Dallas/Fort  Worth  TE^AOCW/Tcwer 

Allan  N.  Crooker 

Military  Operations  Specialist  and  D/FW  Metrcplex  Air 
Traffic  System  Program  Specialist 
Fort  Worth  ARTOC 

Dana  C.  Jones 

Air  Traffic  Control  Specicdist  and  D/FW  Metrcplex  Air 
Traffic  System  Program  Specialist 
Fort  Wbrth  AFOXX: 

'Ihomeis  N.  Ihombru^ 

Air  Traffic  Control  Specialist 
Fort  Worth  ARTCC 

James  S.  Banks 

Air  Traffic  Control  Specialist 
Fort  Wbrth  ARTOC 

Darmy  C.  Vincent 

Air  Traffic  Control  Specialist 

Fort  Wbrth  ARXCC 

Faward  A.  Brestle 

Air  Traffic  Control  Specialist 

Fort  Worth  ARTCC 

Donald  R.  Starnes 

Air  Traffic  Control  Specialist 

Fort  Worth  ARTCC 

Leland  R.  Busbee 

Supervisor  Air  Traffic  Control  Specialist 
Fort  Worth  ARTCC 


vi 


TABLE  OF  OO/TENIS 

Page 

EXECUTIVE  SUMMARY  ix 

1.  INIRDDUCnC^J  1 

1.1  Purpose  1 

1.2  Bac3<ground  1 

1.2.1  Ifede  S  Data  Link  1 

1.2.2  En  Route  Data  Link  Services  and  Functions  3 

1.2.3  Results  of  Mini  Study  1  3 

1.3  Data  Link  Test  Bed  5 

2.  TEST  DESCRIPnOi  5 

2.1  CSojectives  5 

2.2  Test  ^proach  7 

2.3  Test  Conduct  8 

2.3.1  Subjects  3 

2.3.2  Test  Configurations  for  the  Data 

Link  Services  8 

2.3.3  Test  Scenarios  8 

2.3.4  Test  PcTooedures  12 

2.3.5  Data  Collection  14 

2.3.6  Data  Reduction  and  Analysis  15 

3.  TEST  RESUmS  16 

3.1  WIICO  Display  Persistence  16 

3.2  Evaluation  of  the  Service  Iirplementations  17 

3.2.1  Controller  Workload  During  the 

Simulation  Test  Runs  17 

3.2.2  Transfer  of  Ccnirnunication  17 

3.2.3  Altitude  Assignment  18 

3.2.4  Menu  Text  18 

3.2.5  Free  Text  19 

3.3  Inpact  of  Data  Link  Delays,  Failures,  and 

Partial  Equipage  19 

3.4  General  Data  Link  Results  20 

3.4.1  Data  Link  Displays  20 

3.4.2  Data  Link  Controller  Inputs  and 

Procedures  21 

3.4.3  The  Impact  of  Data  Link  on  the  ATC 

Syst^  22 

3.5  Evaluation  of  Study  Adequacy  22 

vii 


TABDE  OF  OCWTENTS  (OCOTINUED) 


Page 

4. 

OMTcmsiais 

22 

5. 

REOCMMENDATia^S 

24 

6. 

REFERENCES 

25 

list  of  TTinSTRATTONS 


Figure 

1  Mode  S  SurveillaxK»  and  Data  Link 

2  ATC  Data  Link  Test  Bed 

3  Test  Scenario  Aircraft  Pouting 

4  Test  Scenario  Sectorization 


Page 

2 

6 

10 

11 


viii 


EXECUTIVE  SmflARX 


mpmsnaf. 


Hhe  Federal  Aviation  Administxaticn  (F7A)  Test  Plan  for  the  Mode  S  Data 
Lihlc  defines  a  two-stage  process  for  oontroller  evaliiation  of  candidate 
air  traffic  control  (AFC)  services.  In  the  first  stage,  "mini"  design 
studies  are  being  conducted  .under  controlled  conditions  which  simulate 
only  the  essential  conponents  of  controller  tasiks  associated  with  the 
services.  Ihe  goal  of  these  studies  is  to  identify  service  delivery 
methods  which  optimize  oontroller  aoc^Ttanoe,  perfozsanoe,  and  workload. 
In  the  second  stage,  full-scale  simulation  studies  will  be  perfonaed  in 
order  to  verify  the  seifety  and  efficiency  of  Data  link  within  the  context 
of  realistic  operational  scenarios.  Ihis  report  presents  the  results  of 
the  second  EAA  controller  Mini  Stui^  of  en  route  ATC  services  developed 
for  inplenentation  on  the  Data  Link  ^stem. 


The  gaieral  purpose  of  this  Mini  Study  was  to  extend  the  results  obtained 
in  Mini  Study  1  and  to  evaluate  the  design  of  tun  functions  which  have 
been  added  to  the  initial  packzige  of  en  route  ATC  services.  The  specific 
objectives  of  the  stcn^  were  to:  (1)  define  applications  and  controller 
procedures  for  the  added  free  text  and  menu  text  services,  (2)  evciluate 
the  refined  altitude  assignment  and  transfer  of  ocninunication  services  as 
well  as  the  text  services  under  more  conplex  test  conditions  than  those 
eoployed  in  Mini  Stuc^  1,  and  (3)  provide  a  preliminary  assessment  of  the 
ispact  cf  Data  Link  time  delays,  system  degrai^tion,  and  partial  Data  Link 
equipage  of  controlled  aircraft. 

Data  Link  functions  were  integrated  with  the  Host  Oonputer  System  (HCS) , 
operational  software,  and  the  Oonputer  Display  Channel  (CDC)  di^lays. 
Gspabilities  of  the  simulation  system  included  radar  data  processing, 
tracking,  and  fll^it  data  irputs.  Operational  Data  Link  functions  and 
procedures  were  integrated  with  current  operationad  procedures  and 
ccnputer  functions.  Data  base  updates  followed  altitude  clearances; 
handoffs  between  sectors  included  radio  frequency  assignments;  and 
adtimeter  settings  were  automatically  uplinked. 

As  dictated  by  the  results  of  Mini  Study  1,  the  Data  Link  transaction  list 
di^lay  was  located  on  the  Plan  View  Di^lay  (FVD) ,  the  altitude 
assignment  service  was  autonatlcally  vplinked  following  a  data  base 
vpdate,  and  transfer  of  oonmunicaticxi  iplinks  were  manuadly  controlled  in 
order  to  dissociate  this  service  from  transfer  of  ocxrtrol.  In  all  cases, 
the  receipt  of  a  downlinked  pilot  WILCX)  response  automatically  deleted 
associated  list  entries. 

The  two  text  services  were  developed  as  general  Data  Link  functions 
applicable  to  a  broad  range  of  r-iparance  and  advisory  n^^ages.  For  this 
study,  menu  text  permitted  the  ocntroller  to  create  a  predetermined  list 
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of  oamcnly  used  ATC  nesseiges  fton  vdiich  a  desired  clearance  could  be 
selected  and  relinked  at  any  time.  Free  text  gave  the  controller  an 
option  to  oontxifie  and  iplink  a  message  in  real-time.  Text  messages  were 
limited  to  20  characters. 


Nine  full-performance  level  air  traffic  controllers  from  the  Dallas/Fort 
Worth  TBAOGN  and  the  Fort  Worth  Oenter  participated  as  subjects  and 
observers  in  a  series  of  ATC  scenarios  presented  at  the  work  stations  in 
the  FAA  Technical  Oenter  Data  Link  test  bed.  Ihe  basic  test  scenario 
enployed  fixes  and  boundaries  frani  the  Universal  Data  Set  (UD6)  adeptation 
to  create  two  routes  carrying  air  traffic  between  two  airports.  Each 
route  traversed  two  low  altitude  departur^arrival  sectors  edjacent  to  the 
edrports,  and  two  hl^  altitude  sectors  located  between  the  low  altitude 
sectors.  A  total  of  24  edrcraft  travelled  throu^  each  sector  during  a  30 
minute  test  run.  Variations  on  the  basic  scenario  were  developed  to 
reduce  learrung  effects,  and  to  test  the  ixpact  of  partial  Data  Link 
equipage.  These  variations  included  the  introduction  of  conflicting 
overfli^it  traffic,  an  increase  in  zur  treiffic  density,  and  a  reduction 
from  100  percent  to  20  percent  Data  Link  equipage  of  the  2drcraft  in  the 
test  scenario. 

The  scenarios  were  used  in  a  series  of  test  runs  designed  to  review  and 
critique  the  text  service  designs  and  to  evaluate  the  irpact  of  making 
different  ocnbinations  of  the  Data  Link  services  available  to  controllers. 
Additional  variables  tested  included  the  duration  for  display  of 
confirmatory  messages  from  the  pilot,  the  hipact  of  Data  Link  system 
failures  in  10  percent  of  the  attempted  uplinks,  and  mixed  Data  Link 
equipage  in  the  eLircraft  fleet.  Both  projective  and  actual  workload 
ratings  were  taken  after  selected  test  runs  using  the  Subjective  Workload 
Assessment  Technique  (SHAT) .  Frefermxs/acoeptability  judgments  also  were 
solicited  &om  the  controllers  for  each  of  the  Data  Link  services  as 
implemented  for  this  study.  Additional  data  collection  \diich  occurred 
during  debriefing  sessions  included  str\]Ctured  discussions  to  elaborate  on 
the  results  obtained  in  the  laboratory,  and  the  conpletion  of  a  wrep-^ 
questicmedre  designed  to  assess  the  adequacy  of  the  test  scenarios  and 
the  operational  value  of  the  tested  services. 


General  controller  opinions  continued  to  provide  strong  positive  support 
for  the  initicLL  package  of  en  route  Data  Link  services.  Working  with  more 
reedistic  ATC  problems  than  those  presented  in  Mini  Study  1,  the  subject 
ocntrollers  concurred  that  the  iapleroentation  of  apprtpriately  ocxifigured 
versions  of  the  four  services  will  significantly  reduce  voice  frequency 
congestion  while  increasing  system  cepacity,  safety,  and  efficiency. 
Althcu^  these  projections  will  require  ccxifirmation  in  operaticxal 
evali»tton  research  using  more  ocnpl^  scenarios  and  greater  air  traffic 
densities,  rated  workload  was  unaffected  in  this  study  by  the  substitution 
of  Data  Link  procedures  for  current  voice  procedures.  Furthermore, 
controller  workload  was  not  significantly  affected  by  Data  Link  delays 
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attributable  to  antenna  xotatlcn  lag,  a  10  percent  rate  of  relink 
fedlures,  or  a  test  environment  in  which  cnly  a  fraction  of  the  aircraft 
were  Data  link  equipped. 

The  conclusions  of  Mini  Stuly  1  were  vipheld  by  the  present  results.  The 
subjects  continued  to  prefer  the  use  of  centralized  FVD  displays  of  Data 
Link  transaction  status,  the  use  of  Data  Link  without  redundant  voice 
ocnnunication,  the.  necessity  for.  downlinked  pilot  confirmation,  and  the 
use  of  automatic  uplinks,  there  feasible,  to  minimize  data  entries. 
However,  the  current  test  conditions  also  presented  situations  vhich  led 
the  controllers  to  suggest  several  refinements  to  the  services.  In 
particular,  subjects  indicated  that  transfer  of  ccnnunicatiai  must  be 
modified  so  that  uplink  authority  transfers  with  the  assignment  of  a  new 
radio  freguoicy,  and  that  cdtitude  assignment  should  permit  the  ocntroller 
to  selectively  izhibit  uplinks.  Results  for  the  text  services  showed  that 
the  controllers  preferred  to  use  rusaru  text  for  control  clearanoes  and 
that  it  must,  therefore,  be  designed  to  permit  auitomatic  system  updates 
uhen  needed.  Free  text  was  preferred  as  a  bacikip  for  radio  fedlures  and 
as  a  method  for  transmitting  eKivisGries  and  other  non-control  messages. 

TWO  Issues  uihich  emerged  during  Mini  Study  1  surfaced  umder  the  present 
testing  conditions.  The  first  of  these  is  a  requirement  to  develop  Full 
Data  Block  (FDB)  displays  for  Data  Link  transactions  in  order  to  reduce 
the  display  scanning  demands  of  monitoring  Data  Link  transactions.  The 
second  is  the  need  to  develop  a  method  far  permitting  flexible  control 
over  uplinks,  NAS  updates,  and  FDB  updates.  This  is  due  to  the  fact  that 
ATC  practices  in  differmit  en  route  centers  rec^iire  that  it  be  possible  to 
selectively  control  these  events  fcxr  each  transaction. 

RECXffECimoWS. 

Based  on  the  results  outlined  above,  several  modifications  to  the  design 
of  the  four  tested  services  are  reoonmended  prior  to  full-scale, 
operational  evaluiation  research.  Briefly,  a  hi^  priority  should  be 
assigned  to  the  development  of  FDB  di^lays  of  transacticxi  states  for 
Data  Link  services.  These  di^lays  should  be  easily  interpretable  and 
should  supplenent  the  transaction  status  list.  Equally  hi^u  priority 
should  be  devoted  to  the  development  of  flexible  control  over  the 
destinations  of  keyboard  and  trackball  data  entries  for  control  clearanoes 
delivered  by  Data  Link. 

In  eKidition,  it  is  reocnmended  that  prevision  be  made  for  linking  menu 
text  services  to  the  remainder  of  the  ATC  system  so  that  control  clearance 
menu  text  uplinks  can  selectively  update  NAS,  the  FI»,  or  both.  Transfer 
of  oomnunicatlon  and  altitude  assignment  also  should  be  modified  in 
aooordanoe  vdth  the  present  results  in  order  to  make  these  services 
ocnpatible  with  the  full  range  of  ATC  procedures  eaiplcyed  in  current  field 
environments. 

Finally,  in  orcler  to  identify  any  remaining  limitations  in  the  modified 
service  designs,  it  is  reoonmended  that  enphasis  be  given  to  the 
development  of  menre  oonplex  K£C  scenarios  for  the  operational  evaluation, 
and  that  this  research  reexamine  the  potential  irpact  of  Data  Link 
fzdlures,  transmission  delays,  and  partial  equipage  environments. 
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1.  INTRODUCTia'?. 


1.1  HJE^POSE. 

Ihis  document  presents  the  results  of  the  second  in  a  series  of  Federal 
Aviation  Administration  (FAA)  air  traffic  controller  evaluation  studies  of 
en  route  air  traffic  control  (ATC)  services  designed  for  inplementation 
in  the  Mode  Select  Beacon  System  (Mode  S)  Data  Link  system.  Specifically, 
this  study  was  conducted  to  evaluate  controller  procedures  for  the  free 
text  and  menu  text  services.  In  addition,  this  study  provided  an 
ofportunity  to  obtain  further  controller  iiputs  regardinr  the  design  of 
the  ciltitude  assignment  and  transfer  of  conmunication  services  tested  in 
the  first  controller  evaluation  (Talotta,  et  al.,  1988),  and  to  estimate 
the  iitpact  of  system  delays,  system  degradation,  and  partial  Data  Link 
equipage  on  controller  workload. 


1.2  BACKGROUND. 


1.2.1  Mode  S  Data  Link 

The  Mode.  S  is  a  secondary  surveillance  radar  which  will  replace  the 
current  Air  Traffic  C3ontrol  Radar  Beacon  System  (AICRBS) .  The  ATCRBS  uses 
a  ground-based  rotating  antenna  that  transmits  continuous  radio  frequency 
(PF)  interrogaticMis  to  vhich  a  transponder  equipped  aircraft  will  respond. 
The  relies  provide  the  ATC  system  with  an  aircraft  identification  code  or 
the  aircraft  edtitude.  Aircraft  location  information  is  provided  by  the 
rotational  position  of  the  antenna  and  the  transponder  response  delay  at 
the  time  a  r^ly  is  received. 

The  Mode  S  will  provide  the  same  functions  as  the  ATCRBS,  but  will  do  so 
more  accurately  vhile  offering  the  additional  capability  of  transmitting 
digitcil  information  across  a  two-^y,  air-ground  Data  Link.  These 
enhcincements  are  possible  because  each  aircraft  will  be  assigned  a  unique 
address  code  vhich  will  be  used  in  the  system's  interrogations  to  select 
only  the  requested  aircraft  to  respond.  The  primary  ccsnrponents  of  Mode  S 
are  illustrated  in  figure  1. 

Because  of  its  flexibility  emd  capacity,  the  Mode  S  Data  Link  promises  to 
be  a  key  to  increased  automation  of  the  ATC  system,  cind,  therefore,  has 
the  potential  to  significantly  enhance  ATC  safety  and  productivity.  One 
of  the  primary  ways  in  which  this  potenticil  will  be  achieved  will  be 
throu^  the  impact  of  Data  Link  on  the  tasks  of  the  air  traffic 
controller. 

The  first  service  to  be  provided  by  Data  Link  will  be  automated  delivery 
of  weather  advisories  to  aircraft.  This  furiction  alone  will  reduce  the 
controller's  tcisk  load  by  eliminating  any  requirement  to  verbally  relay 
j^'eather  data  to  pilots  via  radio.  Hcwever,  the  accelerated  Data  Link 
program  also  calls  for  the  Data  Link  to  mediate  a  vcuriety  of  primary  ATC 
services  which  cue  currently  acoonplished  in  a  conpletely  manual  fashion 
using  voice  radio.  The  prxposed  ATC  services  will  include  transfer  of 
communication,  clecuance  deliveries,  inflight  plan  amendment,  and  a 
variety  of  other  transactions  among  controllers,  pilots,  and  automated 
systems. 
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SURVEILLANCE  AND  DATA  LINK 


The  xiltimate  succsess  of  Data  Link  is  critically  d^iendent  on  the  extent  to 
viiich  it  is  ertplqyed  to  produce  a  system  that  is  well  integrated  with  the 
human  operators  viiio  will  be  required  to  control  and  supervise  its 
function.  Because  Data  Link  will  profoundly  affect  the  manner  in  vAiich 
air  traffic  controllers  aoconplish  their  duties,  it  is  imperative  that 
service  delivery  procedures,  and  the  displays  and  controls  used  to 
interact  with  the  system,  are  designed  with  careful  consideration  of  their 
impact  on  the  performance  capabilities  of  the  controller.  Ihe  intent  of 
the  controller  evaluation  r^xjrted  in  this  document,  and  of  other  studies 
in  this  program,  is  to  insure  that  controller  workload,  performance,  and 
aoc^jtance  are  used  as  primary  inputs  to  the  development  and 
implementation  of  the  Data  Link  system. 

1.2.2  En  Route  T.ink  Services  and  Functions. 

Hie  initial  package  of  ATC  functicxis  scheduled  for  implementation  in  the 
Data  Link  system  includes:  altitude  assignment,  transfer  of  cammunication, 
free  text,  menu  text,  and  possibly  en  route  minimum  safe  altitude  warning 
(EWSAW) .  Ihe  altitude  cissignment  service  will  transmit  digital  ciltitude 
clearances  to  an  aircraft  display.  Hiis  service  may  be  used  as  a 
substitute  for  the  current  voice  radio  altitude  clearance.  Transfer  of 
communication  is  presently  acconplished  by  a  voice  contact  with  the  pilot 
follcwing  a  transfer  of  control  between  sectors.  Using  Data  Link,  this 
service  will  permit  the  transferring  controller  to  send  a  digiteLL  message 
to  the  aircraft  which  will  inform  the  pilot  of  the  radio  frequency  on 
v^ch  the  receiving  controller  will  be  ccmraumcating.  EMSAW  is  a  warning 
service  relayed  to  pilots  by  ATC  when  the  system  predicts  that 
predetermined  minimum  flight  edtitudes  will  be  violated.  Under  Data  Link, 
this  service  may  be  provided  by  sending  the  warning  directly  to  a  cockpit 
display,  rather  than  by  a  voice  radio  message.  This  service  was  not 
evcduated  in  the  study. 

The  two  text  services  cure  more  general  Data  Link  functions  which  eure 
potenticilly  applicable  to  a  broad  range  of  clearance  and  advisory 
messages.  Free  text  will  provide  the  controller  with  a  capability  to 
engage  in  unconstrained  ground-air  communications  with  Data  Link  equiiped 
aircraft.  This  service  will  pjermit  controllers  to  ccttpose  eind  uplink 
textucil  materieil  in  reeil-time,  thereby  providing  an  emergency  back-tp 
channel  for  voice  transmissions.  (Free  text  was  originally  cor»oeived  as  a 
method  for  controlling  aircraft  ejperiencing  emergency  radio  failvires.) 
Free  text  messages  are  presently  not  retained  after  being  sent.  The  menu 
text  service  is  a  Data  Link  function  vAiich  will  permit  controllers  to 
create  emd  retain  a  customized  list  of  ATC  instructions,  each  of  vAiich 
could  be  selected  and  iplinked  eis  needed.  The  primary  purp)ose  of  the  menu 
text  service  is  to  offer  controllers  a  simplified  method  for  uplinking 
common  ATC  messages  vhich  are  used  repetitively  in  specific  sectors. 

1.2.3  Results  of  Mini  Study  1. 

The  first  controller  eveiluation  study  of  the  initial  package  of  en  route 
Data  Link  services  addressed  tiransfer  of  ccmmunication,  altitude 
assignment,  and  EMSAW  described  above  (Talc  a,  et  al.,  1988).  In  Mini 
Study  1,  10  en  route  air  traffic  controller:  articipated  as  subjects  and 
observers  in  a  series  of  hi^ily  simplified  A  scencurios  presented  at  work 
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stations  in  the  FAA  Technical  Center  Eata  Link  test  bed.  Ihese  scenarios 
presented  each  controller  with  three  aircraft  vAiich  received  the  services 
under  evaluation.  Controller  activities  were  hi^ily  scripted,  and  no 
attaipt  was  made  to  simulate  an  actual  ATC  problem.  The  purpose  of  the 
test  Wcis  to  permit  the  controllers  to  evciluate  several  display  and 
procedural  options  for  each  of  the  three  services. 

Both  Plan  View  Display  (PVD)  and  Ccrputer  Readout  Device  (CRD)  locations 
were  tested  for  presentaticxi  of  Data  Link  transaction  status.  This  list 
display  provided  information  regarding  the  service  content,  the  aircraft 
receiving  the  service,  and  the  current  status  of  the  transaction.  Thus, 
the  di^lay  indicated  vhen  a  message  was  ready  for  iplink  (HETD) ,  vixen  it 
had  been  SENT,  vhether  a  technical  acknowledgement  had  been  received  from 
the  ciircraft  transponder  (DEUVERED)  and  any  pilot  response  or  response 
failure  (WIICO,  UNABIZ  or  FAI) . 

In  additicMx  to  these  display  options,  several  procedural  variations  were 
tested.  Uplinks  were  either  initiate  manucilly  by  a  keiboeurd  entry,  or 
were  sent  autcraaticedly  as  a  result  of  a  National  Airspace  System  (NAS) 
event  associated  with  ein  cdtitude  assignment  entry,  transfer  of 
coramunication,  or  the  detecticxi  of  an  EMSAW  eiltitxide  violation. 
Additicyal  test  runs  examined  requirements  for  voice  communications 
between  the  pilot  and  the  controller,  requirements  for  a  confirmatory 
response  from  the  pilot,  and  manual  vs.  automatic  deletion  of  transaction 
list  entries  once  a  transaction  had  been  ooipleted. 

Controller  responses  to  the  test  options  were  assessed  using  projective 
workload  scales  and  preferenoe/aoo^atability  ratings  following  each  test 
nm.  In  addition,  structured  grotp  discussions  and  a  wrap-up 
questionnaire  were  administered  to  elaborate  on  the  quantified  results  and 
obtain  individual  opinions  of  the  Data  Link  services. 

General  controller  responses  to  Data  Link  were  strongly  positive. 
Specific  results  regarding  the  service  design  options  indicated  that  the 
PVD  display  was  preferred  over  the  CRD  display  of  Data  Link  transaction 
status.  The  subjects  also  indicated  that  further  improvements  may  be 
achieved  by  the  development  of  a  Full  Data  Block  (FDB)  indication  of  key 
transaction  states. 

In  general,  automated  procedures  produced  Icwer  wor]d.oad  and  hi(^er 
preference  ratings  than  those  vAiich  required  the  controllers  to  manually 
initiate  i^xlinks  and  delete  cosrpleted  transactions  from  the  status  list. 
However,  the  subjects  eilso  indicated  that  some  services  (e.g. ,  transfer  of 
communication)  must  be  separated  from  the  event  vrtiich  is  used  to  generate 
the  i^xlink  (e.g. ,  acc^Dtance  of  a  hand-off) .  Therefore,  manual  options 
must  be  made  available  for  such  situations. 

Although  the  continued  availability  of  a  reliable  voice  radio  channel  was 
considered  essential,  radio  ccmmunications  which  were  redundant  with  data 
link  messages  were  not  preferred  and  produced  hi^er  projected  workload 
ratings  than  "Data  Link  only"  conditions.  In  addition,  some  form  of  con¬ 
firmatory  response  to  an  uplink  was  considered  mandatory  for  all  services, 
and  a  downlinked  pilot  response  was  found  to  be  a  vcilid  method  for  provid¬ 
ing  this  information  to  the  controller. 
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1.3  DftIA  IJNK  TEST  BED. 

Both  the  initieil  study  discaissed  above,  and  the  research  r^wrted  in  this 
document  were  conducted  in  the  Data  Link  test  bed  facility  located  at  the 
FAA  Technical  Center.  The  Data  Link  test  bed  was  assembled  to  provide 
both  engineering  testing  and  evaluation  Cc^pabilities  for  Data  Link 
services  during  cxaitroller-in-the-loop  simulation.  Figure  2  presents  a 
functional  diagram  of  the  mciin  ccnponents  of  the  test  bed  and  their 
interconnections.  A  key  feature  of  the  test  bed  facility  is  that  it 
permits  development  of  Data  Lihk  services  on  actual  en  route  ATC 
controller  workstations  and  associated  ccnputers  rather  than  on  an 
emulation  system.  As  a  result,  it  will  be  possible  to  iirplement  the  final 
configurations  for  the  tested  services  in  field  test  sites  without 
extensive  functional  modification. 

During  each  run  of  the  simulatioi  study  described  in  this  report,  four 
subject  controllers  were  presented  with  simulated  radar  data  and  ATC 
system  information  from  the  Host  Ocrputer  System  (HCS) .  Ihe  voices  and 
Data  Link  inputs  of  edrcraft  pilots  were  provided  fcy  four  controllers  who 
were  not  participating  as  subjects  in  the  run.  Ihe  Dynamic  Simulation 
system  (DYSIM)  was  used  to  control  aircraft  activity.  A  VAX  11/750 
conputer  generated  all  Data  Link  outputs  and  permitted  flexible 
variations  of  Data  Lihk  procedures  required  by  the  test  design. 

2.  TEST  DESCRIPncaJ. 


2.1  OBJECTIVES. 


Ihe  overall  test  plan  for  controller  evaluation  of  Data  Lihk  ATC  services 
calls  for  research  to  achieve  two  major  objectives.  First,  the  evaluation 
studies  must  determine  the  operational  procedures  and  display  methods  for 
each  of  the  subject  services.  Second,  these  studies  must  evaluate  the 
integration  of  the  Data  Link  services  with  other  controller  activities  and 
ensure  the  acceptability  of  controller  and  system  performance  under 
cperationeil  conditions. 

These  objectives  inply  that  optimization  and  validation  of  Data  Link  ATC 
services  will  require  research  to  examine  a  large  nuitber  of  human  factors 
design  variables,  as  well  as  the  iitpact  of  various  operational  and 
environmental  factors.  In  order  to  address  these  parameters  in  an 
efficient  fashion,  a  two-stage  evaluation  process  was  developed. 

In  the  first  stage,  controlled,  part-task  simulation  studies  are  being 
conducted  with  en  route  controllers  to  reduce  the  number  of  design 
ciltematives  to  a  reasonable  set.  These  "mini”  studies  involve  the  formal 
testing  of  display  and  procedural  cptions  for  each  service,  eis  well  as 
structured  discussions  designed  to  elicit  expert  controller  opinions.  Ihe 
formal  criteria  for  cption  evaluation  in  these  mini  studies  etre  measures 
of  controller  workload  cind  acceptance. 

In  the  second  stage  of  the  evaluation  process,  operational  evaluation 
studies  will  be  performed  in  the  context  of  full-scade  ATC  simulation. 
The  specific  goal  of  this  stage  will  be  to  confirm  the  eptimedity  of  the 
design  of  each  Data  Link  service,  and  to  verify  the  safety  and  efficiency 
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of  Data  Link  under  various  operational  cx>nditions.  Operationeil  evaluation 
studies  will  assess  overall  system  effectiveness,  performance,  cind 
controller  workload  within  ATC  test  soerarios  representing  both  noninal 
and  hi^  levels  of  controller  task  demand. 

The  study  r^xjrted  here  is  the  secmd  Mini  Study  conducted  under  the  test 
plain  outlined  above.  Ihe  general  purpose  of  the  study  was  to  extend  the 
results  obtained  in  Mini  Study  1  and  to  evaluate  the  design  of  the 
remaining  two  functions  included  in  the  initial  package  of  en  route  ATC 
services.  The  specific  dojectives  of  Mini  Stucfy  2  are  listed  below: 

a.  Define  applications  and  controller  procedures  for  the  free  text  and 
menu  text  services  and  functions. 

b.  Evaluate  the  refined  altitude  assignment  and  transfer  of  communication 
services  as  well  cis  the  text  functions  under  more  realistic  test 
conditions  than  those  enployed  in  tte  first  Mini  Study. 

c.  Provide  a  preliminary  assessment  of  the  iitpact  of  Data  Link  time 
delays,  system  degradation,  and  partial  Data  Link  equipage  of  controlled 
aircraft. 

2.2  TEST  APPROACH. 

The  approach  that  was  adopted  bo  meet  the  objectives  of  this  Mini  Study 
involved  the  participation  of  nine  air  traffic  controllers  in  a  series  of 
30-minute  ATC  scenarios  presented  at  the  work  stations  in  the  Data  Link 
test  bed.  Each  test  run  required  four  of  the  subjects  to  actively  control 
individual  sectors  of  en  route  airspace.  Unli)ce  the  first  Mini  Stuc^,  the 
scenarios  used  in  the  test  runs  presented  the  subjects  with  a  realistic 
air  traffic  control  problem  involving  the  movement  of  aircraft  between  two 
airports.  The  subjects  adtemated  as  active  controllers  and  DYSIM  pilots 
in  order  to  permit  each  participant  to  eaqjerience  cill  test  conditions. 

Following  each  test  run,  the  controllers  were  asked  to  provide  workload 
ratings  and,  in  some  cases,  preference  evaluations  for  the  test  options. 
As  in  Mini  Study  1,  these  formal  ratings  were  svpplemented  by  debriefing 
interviews  and  a  wrap-vp  questionnaire  administered  during  post-test 
sessions. 

The  rationale  underlying  the  testing  approach  was  to  utilize  the  test  bed 
to  produce  reeilistic  representations  of  service  design  eiltematives  and 
differing  air  traffic  euid  Data  Link  conditions.  The  goal  of  the  study 
design  Wcis  to  permit  the  subjects  to  integrate  these  dajective  experiences 
with  their  general  knowledge  of  the  en  route  ATC  environment  in  order  to 
provide  data  which  would  guide  the  design  and  refinement  of  the  Data  Link 
services  under  evaluation. 
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2.3  TEST  OCWEUCr. 


2.3.1  Subjects. 

The  subjects  for  this  study  were  nine  current,  full  performance  level 
(FPL)  air  traffic  controllers  frcm  the  Dallas/Fort  Vforth  Terminal  and  the 
Fort  Vforth  Center.  All  of  the  controllers  had  peuirticipated  as  subjects  in 
Mini  Stucfy  1  and,  therefore,  were  familiar  with  the  evolving  Data  Link 
services  and  the  testing  methods  used  in  the  Data  Link  program. 

Of  the  nine  controllers,  ei^t  served  as  subjects  in  the  formal  test  bed 
evaluation.  The  remaining  subject  acted  as  an  observer  during  data 
collection  in  the  test  bed,  and  provided  inputs  only  to  the  debriefing 
interview  and  wrap-^p  questionnaire  items.  The  subjects  vho  participated 
in  the  formal  testing  had  an  average  of  15.7  years  ej^jerieiKe  as  FPL  air 
traffic  controllers. 

2.3.2  Test  Configurations  for  the  DatJ^  T.ink  Services. 

The  displays  and  procedures  lased  for  the  Data  Link  services  evaluated 
during  this  study  were  primarily  based  on  the  findings  of  Mini  Study  1. 
As  dictated  by  those  results,  the  Data  Link  transaction  list  display  was 
located  an  the  PVD.  In  addition,  the  adtitude  aissignment  service  was 
inplemented  in  the  automatic  mode,  while  transfer  of  communication  was 
relinked  manuadly  in  order  to  dissociate  this  service  from  the  transfer  of 
control.  In  further  accordance  with  the  results  of  Mini  Study  1,  UNABLE 
responses  from  the  pilots  were  displayed  as  FAI  in  the  transaction  status 
list,  and  WILCO  responses  served  to  automatically  delete  the  appropriate 
line  from  the  transaction  status  list. 

The  new  text  functions  tested  in  this  study  were  designed  according  to  the 
genercd  guidelines  derived  from  the  previous  services.  The  menu  used  for 
the  menu  text  function  was  constructed  by  the  controller  using  the  work 
station  kejixard  and  was  displayed  as  a  list  on  the  PVD.  Messages  were 
selected  from  the  menu  for  v:plink  by  entering  an  identifying  number  on  the 
ke^lDoard  or  by  trackbcilling  the  menu  text  message  number.  The  content  of 
menu  text  and  free  text  messages  (20  chcuracters  maximum)  was  indicated  in 
the  transaction  status  list  by  displaying  the  first  six  characters  of  the 
message. 

Detailed  procedural  instructions  for  creating  and  vpilinking  text  messages 
and  for  providing  the  altitude  assignmait  and  transfer  of  communication 
services  as  configured  for  this  study  are  presented  on  the  Data  Link  En 
Route  Controller  Chart  shewn  in  appendix  D. 

2.3.3  Test  Scenarios. 

The  bcisic  test  scenario  constructed  for  this  study  used  the  Universal  Data 
Set  (UDS)  adaptation.  Fixes  and  boundaries  were  selected  from  UDS  to 
create  two  routes.  One  of  these  routes  carried  outbound  traffic  from  an 
airport  identified  as  Philadelphia  (FHL)  through  a  low-altitude  departure 
sector,  across  two  hi^-altitude  sectors,  and  down  to  a  low-altitude 
arrival  sector  at  an  airport  identified  as  Atlantic  City  (ACY) .  The 
second  route  completed  the  loop  between  the  two  airports,  transversing  the 
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seane  four  sectors  in  the  opposite  direction.  The  air  routes  and  sector 
boundaries  are  shown  in  figures  3  and  4. 

Ihe  beisic  scenario  included  nine  flints  leaving  from  ACY  to  IHL  and  nine 
flints  from  fflL  to  ACY  with  all  aircraft  flying  at  a  speed  of  400  loiots. 
The  initial  flints  departed  fron  each  airport  simultaneously,  with  five 
additional  flints  d^jarting  at  3-minute  intervals.  These  flints 
appeared  on  the  PVD's  at  12,000  feet,  as  if  th^  eilready  had  been 
transferred  from  the  termincil  facility  to  the  Air  Route  Traffic  Control 
Center  (ARTOC) .  Three  additional  flints  were  initiated  en  route  at  the 
start  of  the  scenario  to  provide  early  traffic  control  opportunities  to 
the  hi^  level  sectors.  The  three  flints  on  the  FHL-ACY  route  were 
initiated  at  fixes  BC2,  E2B,  and  F2A  at  fli^t  levels  (FL)  Ft250,  FL270 
and  FI240,  respectively  (see  figure  3) .  The  three  en  route  flints  on  the 
ACY-HDlj  route  were  initiated  at  fixes  F2G,  G2F,  and  E3A  at  FL260,  FL260, 
and  FI240,  respectively. 

Three  versions  of  this  sceneirio  were  used  during  the  testing  sessions. 
During  the  preliminary  test  runs  used  to  demcxistrate  the  text  services  and 
obtain  an  informal  evaluation  of  their  design,  the  Basic  scenario  as 
described  above  was  enployed.  All  aircraft  were  Data  Link  equipped.  The 
formal  test  runs  were  conducted  with  the  enhanced  versions  of  this 
scenario  described  belcw. 

The  Overfli^t  scenario  was  identical  to  the  Basic  scencirio  with  the 
exo^jtion  that  overfli^t  traffic  was  introduced  on  routes  and  at 
altitudes  vhich  would  interfere  with  the  flints  arriving  and  d^)arting 
from  the  two  airports  in  both  the  low  and  hi^  altitude  sectors.  The 
routes  for  the  overfli^t  aircraft  are  shewn  in  figure  3  as  dashed  lines. 
All  overfli^t  traffic  traveled  at  a  speed  of  300  knots.  At  the  start  of 
the  scenario,  the  first  of  12  overfli^t  aircraft  appeeured  on  the  eastern 
side  at  fix  F2E.  The  remaining  flints  fron  the  eastern  side  appeared  at 
3-minute  intervals.  Nine  additional  overfli^ts  appeared  at  fix  D2C  on 
the  western  side  follcwing  the  same  3-minute  interval  schedule.  The 
altitudes  for  eill  overfli^ts  were  veuried  between  the  high  and  lew 
sectors. 

The  Mixed  Equipage  scerario  contained  eill  the  features  of  the  Overfli^t 
scerario  described  above.  Hewever,  only  a  portion  of  the  aircraft  in  the 
scenario  were  Data  Link  equipped.  In  addition,  the  density  of  the  traffic 
on  the  two  air  routes  was  hi<^Ter  than  that  in  the  Basic  and  Overfli^t 
scenarios.  The  11  Eastern  Airlines  and  American  Airlines  aircraft 
included  in  the  scenario  were  designated  as  Data  Link  equipped  aircraft. 
All  of  the  remaining  34  aircraft  were  non-equipped.  A  diamond  symbol  was 
displayed  as  the  first  cheuacter  in  the  aircraft  identification  line  of 
the  FDB  to  indicate  the  availability  of  Data  Link  for  ccsnmunications  with 
the  equipped  flights. 

Air  traffic  density  was  increased  in  the  Mixed  Equipage  scenario  by  adding 
aircraft  to  the  air  routes.  This  manipxiLation  decreased  the  initial 
separation  between  aircraft  to  approximately  1.5  minutes.  In  addition, 
the  spjeeds  for  each  aircraft  on  the  air  routes  were  Vciried  between  250  and 
400  knots. 
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MINI  STUDY 
AIRCRAFT  ROUTING 


FIGURE  3.  TEST  SCENARIO  AIRCRAFT  ROUTING 


AIRSPACE  SECTORIZATION 


FIGURE  4.  TEST  SCENARIO  SECTORIZATION 


The  object  of  the  basic  scenario  develcpnent,  as  well  as  that  of  the 
enhanced  versions,  was  to  create  an  ATC  environment  in  vrtiich  the  services 
and  functions  under  evzduation  could  be  exercised  in  a  reailistic  manner. 
The  primary  purpose  of  the  additional  task  load  manipulations  contained  in 
the  Overfli^t  and  Mixed  Equipage  Soencirios  was  to  minimize  the  inpact  of 
over  learning  effects  on  controller  judgments  of  the  Data  Link  services. 

2.3.4  Test  Procedures. 

This  Mini  Study  was  conducted  over  a  3-day  period.  The  first  half-day  was 
used  for  subject  pr^riefing  and  familiarization,  vAiile  the  remaining  time 
was  devoted  to  data  collection. 

The  pr^riefing  sessicxi  consisted  of  a  series  of  presentations  designed  to 
acquaint  the  subject  controllers  with  the  services  under  evcLLuation  eind 
the  test  plan.  Since  all  of  the  ocxitrollers  had  served  as  subjects  in 
Mini  Study  1,  the  briefings  were  focused  primarily  on  procedures  for  the 
two  text  services  eind  on  a  description  of  the  test  scenarios.  Additional 
briefings  reviewed  the  results  of  the  first  Mini  Study  and  the  subjective 
workload  eind  preferenoe/aoo^jtability  rating  sccde  methods  that  had  been 
used  for  data  collection  in  that  study.  Identical  rating  methods  were 
used  in  the  present  study. 

Data  collection  activities  for  the  stucfy  were  divided  into  two  major 
parts.  The  first  part  consisted  of  an  initial  review  and  critique  of  the 
free  text  and  menu  text  functions.  During  this  session,  each  subject 
ccnpleted  two  test  runs  at  the  work  stations  in  the  I3ata  Link  test  bed  to 
evaluate  operating  versions  of  the  text  services.  The  Basic  scenario 
without  overfli^t  traffic  was  used  in  these  test  runs  in  order  to 
simplify  the  ATC  problem  and  allow  the  subjects  to  thoroughly  examine  the 
service  procedures  and  displays.  Althou^  the  primary  purpose  of  these 
simulaticxi  runs  was  to  stimulate  debriefing  discussions  regarding  menu 
text  and  free  text,  they  also  served  as  training  sessions  for  subsequent 
formal  testing  in  the  second  part  of  the  study. 

A  secondary  objective  of  the  first  part  of  the  study  was  to  identify  an 
^propriate  duration  for  a  display  of  confirmatory  pilot  responses  to  Data 
Link  messages.  The  results  of  Mini  Study  1  indicated  that  items  on  the 
Data  Link  transaction  status  list  should  be  deleted  autcmatically  vpon 
receipt  of  a  pilot  WII£X)  downlink.  However,  the  results  did  not  indicate 
vhether  the  display  should  be  deleted  immediately  or  should  remain 
available  for  inspection  for  a  brief  period  of  time.  To  address  this 
issue,  each  subject  ccnpleted  one  simulation  run  in  vAiich  the  WILOO 
response  deleted  the  list  entry  immediately,  and  a  second  run  in  which  the 
response  display  persisted  for  12  seconds  after  receipt  of  the  WILCD.  The 
preference/aoc^rtability  scale  shown  in  appendix  B  was  used  by  the 
subjects  to  evaluate  these  display  persistence  options. 

Primary  data  collection  for  the  first  part  of  the  study  was  conducted 
during  a  group  discussion  and  debriefing  which  followed  the  test  bed  runs. 
This  session  was  structured  by  presenting  the  controllers  with  a  series  of 
questions  on  individual  overhead  projection  slides.  Each  controller  Wcis 
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given  a  printed  cx^  of  the  slides  in  order  to  record  his  responses  and 
oanments.  The  prinary  issues  addressed  during  the  debriefing  were 
potentieil  applications  for  the  text  services  cind  service  design 
parameters.  The  detailed  contents  of  the  debriefing  slides  are  contained 
in  c^pendix  A. 

The  second  part  of  this  Mini  Study  consisted  of  a  series  of  formal  data 
collection  runs  in  the  Data  Link  test  bed.  Each  of  the  subjects 
controlled  air  traffic  in  five  test  runs  which  were  presented  in  the  order 
in  which  they  are  described  below.  Runs  1  to  4  were  conducted  using  the 
Overfli^t  scenario,  vhile  run  5  was  ccxiducted  using  the  Mixed  Equipage 
scerario. 

Run  1  -  Baseline/Current  System: 

In  this  run,  the  subjects  controlled  the  air  traffic  in  the  30-ininute 
test  scencirio  losing  contenporary  ATC  prooeduores  and  voice  radio  to 
ccninunicate  with  pilots.  No  Data  Link  services  were  available. 

Run  2  -  Initial  Data  Link  Services  Only  (Altitude  Assignment  and  Transfer 
of  Ocmmonication) : 

This  run  was  identical  to  Run  1  above,  with  the  exo^jtion  that  the 
subjects  were  instructed  to  peorform  all  altitude  assignment  and  transfer 
of  ocranunication  tasks  using  Data  Link.  The  services  were  configured  in 
accordance  with  the  results  of  Mini  Study  1  as  described  in  section  2.3.2 
of  this  report.  Voice  cxaranunicaticai  channels  weore  available  to  the 
subjects  at  all  times,  and  were  used  to  acccnplish  all  other  ATC  services. 
All  v^olinks  were  completed  successfully  and  acknowledged  by  the 
siimolaticxi  pilots  using  a  downlink.  In  addition,  for  this  condition  and 
cill  subsequent  runs,  antenna  rotation  delays  were  simulated  for  Data  Link 
transactions.  Thus,  a  randomly  distributed,  0-  to  6-second  delay  was 
added  to  the  ground-air  tumcuxund  time  for  each  uplink. 

Run  3  -  Full  Data  Link  Services  (Altitude  Assignment,  Transfer  of 
Communication,  Free  Text,  and  Menu  Text) : 

This  test  run  was  identicad  to  Run  2  above,  with  the  exception  that  the 
free  text  and  menu  text  services  were  available  to  the  subjects  in 
addition  to  the  eiltitude  assignment  and  transfer  of  communication 
services.  Each  controller  was  permitted  to  devise  a  custcHiiized  set  of 
menu  text  messages  appropriate  to  his  assigned  sector  prior  to  the  test 
run.  The  use  of  both  text  services  was  left  to  the  discretion  of  the 
controller.  In  all  cases,  the  controllers  were  encouraged  to  use  the 
available  Data  Link  services  vhenever  they  were  applicable. 

Run  4  -  Full  Data  Link  Services  -  10  Percent  Technical  Ackncwledgement 
Failure: 

This  condition  made  all  four  Data  Link  services  available  as  described 
cibove.  However,  in  order  to  determine  the  inpact  of  Data  Link  system 
failures,  an  average  of  1  in  10  ip)links  resulted  in  a  failed  technical 
acknowledgement  from  the  simulated  aircraft  transponders  and  associated 
electronic  equipment.  This  failure  was  displayed  eis  a  No  Acknowledgement 


(NAK)  on  the  appropriate  line  of  the  transaction  list.  The  occurrence  of 
a  NAK  required  the  controllers  to  r^jeat  the  uplink  or  contact  the  pilot 
by  voice  radio. 

Run  5  -  Rill  Data  Link  Services  -  Mixed  Equipage: 

The  fined  test  condition  etnployed  the  Mixed  Equipage  scenario  described  in 
section  2.3.3  in  order  to  assess  the  effects  of  only  partied  equipage  of 
the  aircraft  fleet.  To  simulate  the  operational  environment  at  early 
stages  of  Data  Link  system  inplementation,  only  11  of  the  aircraft  (20 
percent)  in  the  sceneirio  were  cap^le  of  receiving  Data  Link 
ocniraunications.  As  noted  in  section  2.3.3,  this  test  run  edso  included  a 
decreased  initial  separaticxi  among  aircraft  in  cerparison  to  the  first 
f  Air  runs.  As  in  run  4,  approximately  10  percent  of  uplinks  resulted  in  a 
failed  technicad  acknowledgement. 

Follcwing  each  of  the  test  runs  the  subjects  caipleted  individuad  workload 
and,  in  sane  cases,  preference/aoo^jtability  ratings.  After  all  test 
conditions  had  been  caipleted  by  adl  subjects,  a  second  group  discussion 
debriefing  session  was  conducted.  The  subjects  also  caipleted  individuad 
wrc^>-rp  questionnaires  during  this  final  debriefing  session.  The 
assessment  techniques  used  for  the  ratings,  interview,  aind  questionnaire 
aire  described  in  the  next  section  of  this  r^xsrt. 

2.3.5  Data  Oollection. 

Data  oollection  for  the  second  part  of  this  Mini  Study  was  conducted  using 
objective  measures  of  Data  Link  activity  and  subjective  ratings  of 
workload  and  preference  taken  after  the  test  runs.  In  addition,  a  final 
debriefing  discussion  and  a  wrap-up  questionnaire  were  used  for  data 
oollection  in  a  post-test  sessicai. 

The  workload  and  preference  scades  were  identical  to  those  used  in  Mini 
Study  1.  In  that  study,  tlie  scales  were  used  to  determine  the  impact  of 
different  procedural  aind  interface  design  options  on  controller  responses. 
In  the  pzresent  study,  these  options  were  fixed,  and  the  primary  focus  of 
the  reseeirch  was  on  the  effects  of  various  mixes  of  Data  Link  services  eind 
of  limited  operational  variations  in  a  ^aecific  simulation  sceneurio.  As  a 
result,  the  application  of  the  rating  scales  was  somevhat  different. 

The  basic  workload  rating  technique  used  in  the  Data  Link  mini  studies  is 
joxwn  cis  the  Subjective  Workload  Assessment  Technique  (SWAT) .  This 
rating  method  permits  a  subject  to  quantify  the  workload  of  an  ATC 
situation  by  cheeddng  the  appropriate  de.^K.xiptor  on  each  of  three,  3 -point 
scales.  The  individued  sc^es  refer  to  time  load,  the  level  of  mental 
effort  required,  and  the  degree  of  psychological  stress  experienced.  The 
SWAT  rating  scale  is  described  more  fully  in  afpendix  B. 

In  this  Mini  Study,  two  versions  of  SWAT  were  used.  The  basic  SWAT 
version  was  used  by  the  controllers  to  provide  ratings  of  the  workload 
actually  ejperienced  by  the  controllers  during  each  formal  test  run. 
Thus,  the  SWAT  ratings  permitted  corparisons  of  workload  differences 
between  current  controller  procedures  and  Data  Link  procedures  within  the 
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cxDntext  of  the  specific  simulation  scenarios  used  in  this  study.  A 
projective  ^plication  of  SWAT  (FROSWAT)  was  used  after  selected  runs  to 
pennit  controllers  to  project  the  workload  that  would  be  associated  with 
each  of  the  tested  services  on  a  moderately  busy  work  day  at  their  normal 
control  positions. 

Both  SWAT  and  FRQSWAT  ratings  were  transformed  to  single  intervaJ  values 
on  a  0  to  100  ocmbined  workload  scale.  The  mapping  of  the  time,  effort, 
cind  stress  ratings  to  the  intervcLL  sccue  was  accaiplished  using  conjoint 
meeisuranent  and  scaling  aneilysis  of  SWAT  ceu^d  sorts  performed  by  each  of 
the  controllers  during  Mini  Study  1.  The  purpose  of  the  sorting  task  is 
to  tailor  the  workload  sccile  to  each  controller's  conception  of  hew  the 
three  factors  ooribine  to  produce  different  levels  of  workload.  A  more 
ccnplete  description  of  the  card  sort  analysis  is  presented  in  Talotta,  et 
al.,  1988. 

Preference/aoc^jtability  scales  were  adso  ccnpleted  after  selected  test 
runs  to  assess  subject  preferences  for  each  Data  Link  service  eis 
inplemented  for  this  study.  The  form  used  bo  make  these  ratings  is  shewn 
in  appendix  B.  Briefly,  this  form  required  the  subjects  to  determine 
whether  the  service  inplementation  was  aco^jtable  or  carpletely 
unacc^rtable.  If  acceptable,  the  controller  provided  a  preference  rating 
ranging  from  1  (highly  preferred)  to  7  (acc^jtable,  but  not  preferred) . 

In  additicxi  to  these  rating  scales,  objective  measures  of  Data  Link  usage 
were  aubcroatically  collected  by  best  bed  cenputers  during  each  test  run. 
These  measures  included  tabulations  of  the  number  of  ccnpleted 
transactions  for  each  service,  as  well  as  the  number  of  failed  v^links. 

Two  additional  data  collection  techniques  were  enployed  during  the  fined 
debriefing  session.  The  first  of  these  was  a  structured  discussion 
similar  to  that  used  during  the  first  part  of  the  study.  Each  question 
was  presented  on  ein  overhead  projection  slide,  and  subjects  were  given 
printed  copies  of  the  slides  to  record  their  canroents.  The  primary 
purpose  of  the  structured  discussion  was  to  elaborate  on  the  results  of 
the  test  bed  runs  and  to  generate  potentied  solutions  to  any  detected 
problems.  The  questions  included  in  this  session  are  presented  in 
appendix  A. 

The  second  measurement  instrument  used  during  the  debriefing  was  a  wrap-rp 
questionnaire  (see  appendix  C) .  The  questionnaire  covered  issues 
regcunding  the  adequacy  of  the  simulation  scenarios,  the  cperational  value 
of  the  services  tested,  aind  their  inpact  on  the  controller's  task. 

2.3.6  Data  Reduction  ctnd  Analysis. 

Ratings  of  controller  workload  eind  preference  were  analyzed  using  stcindard 
tests  of  statistical  significcince  appropriate  to  the  measurement  scale 
chcuracteristics  of  the  data  collect^.  Because  of  the  interval  scale 
nature  of  the  SWAT  and  PROSWAT  scores,  these  data  were  analyzed  using 
peurametric  tests.  Nonparametric  methods  were  used  in  the  einalysis  of  the 
ordinal  preference  ratings. 
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The  7-point  rating  data  obtained  from  the  wrap-up  questionnaire  were 
evaluated  using  a  Student's  t  procedure  designed  to  evaluate  the 
significance  of  differences  in  ratings  from  the  scale  mic^int  and  from 
the  grand  mean  ratings. 

All  remaining  rarrative  responses  obtained  during  the  debriefing  session 
were  sununarized  to  produce  concise  descriptions  of  the  types  and  frequency 
of  occurrence  for  each  comment  received.  In  all  cases,  the  goal  of  these 
descriptive  anedyses  Wcis  to  determine  the  strength  and  direction  of 
COTtroller  opinioTS  regctrding  the  study  issues. 

3.  TEST  RESUIiTS. 

The  detailed  results  obtained  with  the  assessment  techniques  described 
above  are  contained  in  three  appendixes  to  this  r^)ort.  Analyses  of  the 
workload  and  preferenoe/aooeptability  ratings  and  of  the  recordings  of 
Data  Link  transactions  cue  presented  in  appendix  B.  An  ancilysis  of  the 
results  of  the  group  debriefing  discussions  is  presented  in  appendix  A. 
^^pendix  C  contains  the  results  of  the  firicd  wrap-vp  questionnaire. 

This  section  of  the  r^wrt  draws  ipon  the  contents  of  all  three 
appendixes  to  address  findings  vhich  eue  pertinent  to  each  of  the 
following  topics. 

3.1  WII£P  DISPLAY  PERSISTENCE. 

A  preliminary  issue  addressed  during  the  first  part  of  this  study  was  the 
time  needed  by  controllers  to  determine  whether  a  Data  Link  transaction 
had  been  successfully  oonpleted.  No  significant  difference  was  detected 
in  controller  preferences  for  the  0-  and  12-second  cptional  durations  for 
display  of  a  WIIXX)  from  a  pilot  in  response  to  an  uplink.  Examination  of 
the  preference  ratings  and  the  results  of  the  wrap-up  questionnaire  ^cwed 
that  the  subjects  were  evenly  split  in  their  choice  of  an  immediate  or 
delayed  cancellation  of  this  confirmatory  response. 

Discussions  conducted  during  the  first  debriefing  session  indicated  that 
this  split  cpinion  was  motivated  by  two  conflicting  concerns. 
Essenticilly,  edthou^  an  extended  di^lay  persistence  ensures  that  the 
controller  will  be  aware  of  the  successful  completion  of  a  Data  Link 
transaction,  it  also  tends  to  add  to  clutter  on  the  transaction  list 
display.  Those  controllers  vho  preferred  immediate  deletion  of  a 
transaction  line  upon  receipt  of  the  WILOO  eilso  afpeared  to  prefer  minimal 
presentation  of  transaction  status  messages  (i.e.,  failures  only  rather 
than  SENT,  DELIVERED,  etc.). 

One  iitplication  of  this  result  is  that  a  phased  introduction  of  assigning 
the  responsibility  for  Data  Link  to  ATC  ccaiputer  systems  may  be  required 
to  meet  the  needs  of  different  controllers.  Early  in  the  inplementation 
process,  controllers  may  be  required  to  monitor  and  verify  all  stages  of 
Data  Link  transactions.  However,  eis  system  confidence  is  attained,  only 
displays  of  transaction  failures  may  be  needed  for  verifying  accurate 
communication  via  Data  Link.  Alternatively,  it  may  be  necessary  to 
provide  controllers  with  both  ein  easily  interpreted  minimal  display  of 
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essentieil  transaction  statiis  information  in  the  FDB,  emd  an  optioral  list 
display  containing  sufficient  information  to  track  each  stage  of  a  Data 
Link  transaction. 


While  this  design  issue  will  require  further  examination  in  future 
research,  the  ccnpranise  WIDX  dL^lay  persistence  of  6  seconds  used 
during  the  second  part  of  the  current  stucfy  wcis  found  to  be  acceptable  to 
the  subject  controllers. 

3.2  EVAimnCW  OF  THE  SERVICE  IMPI^MEWIMT»7S . 

3.2.1  Oontroller  Workload  Purina  the  SiTwilat-ion  Test  Runs. 

The  SWAT  ratings  collected  after  each  test  run  were  used  to  assess  the 
actual  workload  eiqjerienoed  by  the  subjects  vhile  controlling  traffic  in 
the  COTitext  of  the  specific  simulation  scenario  used  in  this  study.  A 
primary  finding  derived  frcm  the  analysis  of  these  ratings  was  that 
neither  the  introduction  of  the  altitude  assignment  and  transfer  of 
comraunication  services  nor  the  addition  of  the  menu  text  and  free  text 
functions  produced  a  significant  increase  or  decrease  in  controller 
workload  over  current,  non-Data  Link  procedures. 

While  this  result  si^jports  the  cperational  suitability  of  the  initial 
package  of  Data  Link  services,  it  should  be  noted  that  the  test  subjects 
felt  that  the  overall  traffic  load  of  the  test  scenario  was  lew  in 
cenparison  to  their  normal  ATC  work  environments.  Therefore,  these 
findings  may  be  subject  to  change  vhen  the  services  are  tested  in  more 
ccnplex  operational  that,  even  at  the  low  level  of  subject  training  and 
familiarization  employed  in  this  study,  the  controller  tasks  involved  in 
delivering  the  tested  services  had  no  demonstrable  negative  iitpact  on 
perceived  workload. 

3.2.2  Transfer  of  Coimnunication. 

As  suggested  by  the  results  of  Mini  Study  1,  this  service  was  implemented 
in  tile  manueil  mode  in  order  to  permit  controllers  to  delay  the  iplink  of  a 
new  PF  after  a  transfer  of  control  had  been  ccrpleted. 

Despite  the  ccnparatively  lew  workload  ratings  assigned  to  this  service, 
results  of  the  debriefing  discussions  indicated  that  further  refinement  of 
transfer  of  cointnunication  will  be  required  prior  to  the  cperationeil 
evaluation  study.  Specifically,  the  service  design  used  in  this  study 
transferred  Data  Link  ccnanunication  capability  to  the  receiving  oontroller 
upon  aoc^>tance  of  the  hand-off.  This  procedure  violates  current  ATC 
practice  in  vhich  voice  conmunication  re^»nsibility  remains  with  the 
transferring  controller  until  the  transfer  of  ccmrnunication  hcis  been 
completed.  In  order  to  bring  Data  Link  procedure:'  'n  line  with  this 
standard,  apprepriate  restructuring  will  be  require;.  ■>  transfer  vplink 
authority  only  after  the  transfer  of  ccmmunication  hae  >en  cotpleted  eind 
confirmed  by  a  pilot  WILCO  downlink. 


3.2.3  Altitude  AssionmaiL 


Preference  ratings  shewed  that  the  autcroatic  uplink  of  this  service  would 
be  less  desirable  than  would  have  been  predicted  from  the  results  of  Mini 
Study  1. 

As  indicated  by  the  debriefing  results,  the  relatively  poor  performance  of 
altitude  assignment  in  this  study  was  primarily  due  to  the  presentation  of 
cin  operatianed  prx^blem  in  the  test  scenarios  that  required  control  actions 
in  vhich  oocpling  of  a  MAS  assigned  edtitude  i^x^ate,  an  FDB  i:$xiate,  and  an 
uplink  would  be  unacc^jtable.  In  the  current  version  of  altitude 
assignment  these  three  events  occur  simultaneously  for  all  situations. 

Suggestions  from  controllers  for  alleviating  this  problem  reinforced  the 
results  of  Mini  Stu^  1,  vhich  indicated  that  full  control  over  the 
destinatiOTs  for  data  entries  may  be  required  for  individual  transactions. 
Ihus,  it  c^^pears  that  vhile  automatic  vplinks  and  updates  may  be  preferred 
as  a  default  condition,  it  must  also  be  possible  to  override  this  c^ion 
to  permit  the  controller  to  inhibit  the  uplink  or  the  NAS  update. 

Ckranents  recorded  from  the  preference  rating  forms  and  the  wr^j-up 
questionnaire  also  indicated  that  the  workload  of  the  altitude  assignment 
service  would  be  reduced  by  placing  an  indication  of  transaction  status  in 
the  FT®.  This  suggestion  also  supported  the  results  of  the  first  Mini 
Study  in  vhich  an  FIB  di^lay  was  recommended  as  an  enhancement  to  the 
transaction  list  presented  on  the  PVD. 

3.2.4  Menu  Text. 

As  with  most  of  the  other  services,  preference  ratings  for  the  menu  text 
irplementation  were  hi^.  While  all  of  the  controllers  rated  the  basic 
menu  text  concept  as  "good”  or  "very  good”  in  the  wrap-ip  questionnaire, 
two  primary  problems  revealed  in  the  debriefing  discussions  inc?icate  that 
this  service  oou]d  be  iirproved. 

The  wrap-vp  questionnaire  results  indicated  that  menu  text  would  be  a 
preferred  method  for  issuing  r^ietitive  control  clearances  that  are  common 
to  a  specific  sector.  However,  such  clearances  often  require  the 
controller  to  vpdate  NAS,  and  no  provisicxi  for  linking  menu  text  vplinks 
to  NAS  was  included  in  the  current  iitplementaticxi.  As  shown  by  the 
FROSWAT  scores,  the  requirement  to  reenter  data  significantly  increased 
the  projected  workload  for  the  text  functions. 

Integration  of  menu  text  transactions  with  NAS  will  prcAably  require  a 
capability  to  select  the  type  of  interaction  needed  in  specific  cases  in 
order  to  provide  flexible  use  of  menu  text  for  interim  altitude 
assignments,  speed,  and  heading  changes,  etc.  To  remain  consistent  with 
edtitude  eissignment,  menu  text  transactions  should  allow  for  selective 
updates  of  NAS  cind  the  FDB  as  well  eis  uplinks. 

A  second  problem  with  the  menu  text  function  noted  by  controllers  in  the 
debriefing  discussions  was  the  display  of  menu  text  message  content  in  the 
Data  Link  transaction  status  list.  In  its  tested  form,  the  first  six 
characters  of  a  message  were  di^layed.  Because  vplinks  often  consisted 
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of  a  verb  (e.g. ,  clinib)  followed  by  specific  quantitative  information,  the 
transaction  di^lay  provided  insufficient  message  content  bo  permit 
discriminatiai  among  different  simultaneous  transactions.  In  order  to 
remecfy  this  problem,  it  was  suggested  that  standard  templates  be  used  for 
ocaistructing  menu  messages.  Such  standardization  would  permit  the 
ocmputer  system  to  extract  essentied  data  from  the  message  and  display  it 
in  the  limited  space  cmi  the  list.  Di^lay  of  the  assigned  menu  text 
message  number  in  the  status  list  was  edso  a  suggested  solution. 

3.2.5  Free  Text. 

IKDSWftT  and  preference  ratings  for  the  free  text  function  were 
statistically  equivalent  to  those  assigned  to  menu  text.  As  expected,  the 
controllers  indicated  that  free  text  would  be  most  suitable  for  non- 
control  messages  to  aircraft  and  advisories  because  of  its  unrestricted 
format,  and  consequent  inability  to  permit  autanatic  error  checking  by  ATC 
cotpubers.  In  additicxi,  the  subjects  felt  that  free  text  would  be  useful 
for  cannunicating  with  aircraft  esqaeriencing  emergency  radio  failures. 

Primary  improvements  to  free  text  suggested  during  the  debriefing 
discussions  were  to  increase  maximum  message  length  beyond  the  current  20 
characters,  emd  to  provide  an  ability  to  store  emd  retrieve  free  text 
messages  for  r^aetitive  use. 

3.3  IMPACT  OF  DATA  LINK  IMAYS.  FAItURES.  AND  PARTIAL  EQUIPAGE. 

Data  link  f2dlurcs,  delays,  and  mixed  Data  Link  equipage  in  the  aircraft 
fleet  were  addressed  during  data  collection  in  order  to  obtain  an  initial 
assessment  of  the  potential  iitpact  of  these  primary  operational  issues  on 
system  performance.  Using  SWAT  workload  ratings  as  a  criterion,  the  data 
indicated  that  neither  the  tested  levels  of  Data  Link  transmission  delays 
associated  with  antenna  rotation  (0-  to  6-seoonds) ,  nor  the  occurrence  of 
10  percent  fedled  vplinks  (NAK's)  significantly  increased  controller 
workload  over  current  voice  procedures  in  the  simulation  scenario  used  for 
this  stucfy.  As  noted  ectrlier,  these  scenarios  did  not  seriously  tax  the 
performance  capabilities  of  the  test  cxxTtrollers.  Other  results  from  the 
debriefing  discussions  and  the  wrap-vp  questionnaire  also  indicated  that 
NAK's  and  system  delays  were  not  perceived  by  the  subjects  as  significant 
iirpediments  to  Data  Link  corinunication. 

Discussicxi  of  NAK's  indicated  that  they  would  have  little  or  no  effect  on 
work  methods.  One  controller  noted  that  since  NAK  responses  were  received 
faster  than  WILCD's,  in  this  simulation,  resending  the  data  or  making 
radio  contact  with  an  aircraft  did  not  significantly  increase  transaction 
time.  No  clear  preference  was  found  among  the  subjects  regarding  an 
appropriate  method  for  handling  failed  uplinks.  Both  voice  and  repeating 
the  uplink  were  viewed  as  feasible  alternatives,  depending  ipon  the  time 
criticcility  of  the  message. 

Debriefing  discussions  of  Data  Link  transmission  delays  also  indicated 
that  the  tested  range  of  antenna  rotation  lags  would  not  significantly 
impact  work  methods  for  the  planned  initieil  services.  One  subject  felt 
that  delays  may  eixxxirage  a  beneficial  increase  in  the  level  of 
anticipatory  controller  responses  to  air  traffic  situations.  Ihe  wrap-up 
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questioTnaire  results  also  indicated  that  response  tiroes  for  Data  Link 
were  rated  "scroievAiat  good”  or  better  by  all  of  the  subjects. 
Nevertheless,  of  the  few  least-liked  features  of  Data  Link  roentioned  in 
the  questionnc  're,  potentieil  response  time  delays  were  cited  by  some 
subjects,  indicating  a  continued  concern  over  this  factor. 

The  SWAT  ratings  also  reveeiled  no  significant  inpact  of  a  mixed 
environment  of  Data  Link  equipped  and  non-equipped  aircraft  on  controller 
workload  in  the  present  test  scenario.  Although  the  SWAT  scores  shewed  an 
apparent  average  workload  increase  for  the  partial  equipage  test 
condition,  it  was  not  statistically  different  than  the  baseline  condition. 
Ihe  trend  for  an  increcise  in  workload  may  have  been  due  to  the  increase  in 
traffic  load  for  the  mixed  equipage  scenario.  However,  since  scare 
subjects  indicated  that  the  requirement  to  closely  monitor  for  equipage 
indicators  was  a  potential  workload  factor,  this  variable  will  require 
detailed  examination  during  the  operational  evaluation  stuefy. 

3.4  GENEE^  DATA  UNK  RESULTS. 


3.4.1  Data  T.ink  Displavs. 

No  consensus  was  achieved  regarding  the  number  and  types  of  transaction 
status  messages  that  should  be  displayed  in  the  transaction  status  list. 
Those  subjects  who  preferred  a  minimal  display  felt  that  it  was  necessary 
to  present  only  an  indication  of  a  failed  transaction  (i.e.,  NAK  or  NO 
REPLY) .  This  choice  appeared  to  be  based  on  a  desire  to  decrease  display 
clutter  by  relying  on  the  assunpticai  that  no  indication  would  inply  the 
oonpletion  of  a  successful  Data  Link  transaction.  The  subjects  vho 
favored  full  display  of  transaction  status  (i.e.,  HELD,  SENT,  DELIVERED, 
WILDO,  NAK,  etc.)  indicated  that  displaying  the  progress  of  a  transaction 
would  permit  controllers  to  flexibly  monitor  Data  Link  and  intervene  as 
required. 

As  noted  earlier  in  this  r^»rt,  the  lack  of  a  consensus  on  this  design 
issue  may  require  either  a  pheised  reduction  of  display  content  as  Data 
Link  is  introduced  to  the  field,  or  provision  of  both  a  detailed  display 
of  transactions  in  a  list  and  a  minimal  di^lay  in  the  FDB. 

The  results  of  the  first  Mini  Study  shewed  that  Data  Link  transaction 
status  should  be  displayed  in  a  central  rather  than  a  peripheral  location 
(i.e.,  PVD  rather  than  O®) .  In  addition,  the  subject  controllers 
suggested  that  an  FDB  display  may  provide  even  greater  inprovements  in  the 
usability  of  this  information.  These  preferences  were  reiterated  by  the 
subjects  in  the  present  study  after  working  with  a  more  reeilistic  test 
scenario,  vhich  required  increcised  reliance  on  the  transaction  display. 
In  peurticuleu:,  the  lack  of  an  FDB  display  for  the  status  of  eiltitude 
assignment  appeared  to  be  one  reaison  for  its  increcised  workload  rating  in 
ccfftparison  to  the  other  services. 
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.4.2  Data  T.ink  Controller  Inputs  and  Procedures. 

The  results  of  Mini  Stix^  1  shewed  that  data  entries  required  for  sending 
vplinks  and  for  managing  the  transaction  displays  ^ould  be  minimized  to 
reduce  controller  workload  associated  with  Data  Link.  Therefore, 
autcroatic  message  preparation,  uplinks,  and  deletion  of  coirpleted 
transactions  were  recemmended,  vAien  feasible.  The  results  of  the  present 
study  confirmed  these  earlier  findings  and  extended  them  to  the  text 
services. 

Controller  ejqjeriences  with  the  more  cenplex  test  scenarios  in  this  study 
shewed  that,  like  transfer  of  ccmnunication,  altitude  assignments  could 
not  be  autonaticcLLly  tplinked  under  all  oonditicxis.  Because  of  this,  the 
controllers  reoammended  that  a  method  be  developed  for  selecting  a  default 
destination  for  data  entries  (i.e. ,  automatic  vplink  with  the  NAS  vpdate) 
with  the  capability  to  override  this  default  condition  and  select 
alternate  destinaticais  (i.e.,  vplihk  only,  NAS  update  only,  FDB  vpdate, 
etc.) . 

A  primary  procedural  opinion  ejqiressed  by  the  subjects  in  Mini  Study  1  was 
that  the  number  of  data  entries  required  to  ccaiplete  Data  Link 
transactions  ^ould  be  minimized.  This  preference  was  reiterated  in  the 
present  with  respect  to  the  menu  text  function.  Specifically,  the  subjects 
noted  that  the  use  of  menu  text  for  control  cleeurcinoes  will  require 
cQtpling  of  this  service  with  the  remainder  of  the  AITC  systems  in  order  to 
avoid  dual  data  entries.  Thus,  it  should  be  possible  for  a  menu  text 
i^jlink  to  vpdate  NAS,  the  FDB,  or  both  as  required.  The  controllers  also 
indicated  that  data  entries  needed  for  construction  of  menu  text  messages 
could  be  reduced  by  using  message  tenplates.  These  standard  formats  would 
require  entry  of  only  specific  data  (e.g. ,  an  altitude  or  i^jeed)  rather 
than  the  entire  instruction. 

The  findings  of  the  first  Mini  Stuc^  indicated  that  Data  Link  services 
should  emulate  current  voice  procedures  in  maintaining  responsibility  for 
ATC  with  the  appropriate  controller.  Specifically,  the  results  showed 
that  the  iplink  of  a  new  RF  must  be  acoonplished  by  the  transfering 
controller  rather  than  the  receiving  controller.  The  present  results 
indicated  that,  in  addition.  Data  Link  eligibility  should  not  be 
transferred  to  the  receiving  controller  until  the  transfer  of 
communication  is  conpleted  and  WII£X)ed.  This  modification  will  bring  Data 
Link  into  alignment  with  current  procedures  by  xnaintaining  both  voice  and 
Data  Link  coranunications  responsibility  at  the  transferring  controller's 
position  until  the  ccnplete  transfer  of  control  and  transfer  of 
communication  sequence  is  accoarplished. 

This  study  presented  the  first  epportunity  to  examine  Data  Link  in  a 
realistic  ATC  sceneurio  v4iich  emfiTasized  the  delivery  of  the  initial  Data 
Link  ATC  services  without  redundant  voice  communication.  While  the 
subject  controllers  unanimously  favored  this  situation,  initial  comments 
regarding  the  feasibility  of  a  future  "silent"  Data  Link  environment  were 
offered  by  seme  controllers  during  the  final  d^riefing  discussion.  These 
subjects  noted  the  potential  workload  problems  associated  with  assigning 
both  the  tasks  of  monitoring  aircraft  separation  and  communication  to  the 
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visual  system.  While  efforts  to  integrate  Data  Link  transaction 
information  into  easily  interpreted  FDB  display  will  vaidoubtedly  reduce 
the  demands  of  these  ducil  tasks,  consideration  must  be  given  in  future 
work  to  the  develc^ment  of  synthesized  auditory  Data  Link  displays  or  to 
the  possibility  that  a  rational  mix  of  voice  and  Data  Link  communications 
will  provide  an  optimal  approach  to  future  ATC. 

3.4.3  The  Impact  of  Data  T.ink  on  the  ATC  System. 

The  results  presented  in  the  foregoing  portions  of  this  section  support  a 
number  of  requirements  for  modifications  to  the  current  inplementations  of 
the  initicd.  package  of  Data  Link  services.  While  these  results  suggest  a 
number  of  changes  and  enphasize  some  open  design  issues,  it  should  be 
noted  that  roost  of  the  modifications  will  be  refinements  to  services 
alreac^  considered  by  the  controllers  to  be  positive  contributions  to  the 
ATC  system.  In  general,  projected  workload  ratings  were  low  and 
controller  preference  vras  uniformly  hi^  for  eill  of  the  services  and 
functions  tested  in  this  study.  Furthermore,  the  wrap-vp  questionnaire 
indicated  that  Data  Link  continued  to  be  viewed  by  the  subjects  eis  an 
extremely  positive  enhancement  to  the  ATC  system.  Its  effects  on  system 
capacity,  controller  workload,  and  pilot-controller  ccmmunication  were  all 
rated  hi^ily.  The  controllers  clLso  indicated  that  Data  Link  will 
significantly  enhance  system  efficiency  and  safety.  Other  general 
comments  from  the  subjects  emphasized  the  positive  iirpact  of  Data  Link  on 
reducing  RF  congestion,  traffic  handling,  and  time  available  for 
additional  controller  tasks. 

3.5  EVAIUATION  OF  STUPy  AimJACY. 

Several  comments  were  elicited  on  the  wrap-vp  questionnaire  regarding  the 
methods  and  procedures  used  in  this  Mini  Study.  These  comments  were 
directed  primarily  toward  enhancing  the  methodology  for  use  in  the 
operational  evaluation  study. 

In  general,  the  subjects  felt  that  the  realism  of  the  simulation  was  good. 
However,  five  of  the  subjects  commented  that  traffic  levels  should  be 
increased  in  future  research.  This  result,  edong  with  the  relatively  low 
SWAT  workload  scores  assigned  to  all  versions  of  the  study  scenario, 
indicated  that  controller  task  loading  should  be  increased  in  order  to 
fully  exercise  Data  Link  services  in  the  operational  evaluation  study. 
Other  related  comments  indicated  that  realism  and  task  complexity  would  be 
enhanced  by  increasing  the  number  of  aircraft  conflict  situations  in  the 
scenario,  and  by  avoiding  the  limitations  of  the  DYSIM  simulation  mode  in 
future  stnjdies. 

4.  oo^cmsiajs. 

The  results  of  the  study  presented  in  this  report  support  several 
conclusions  regarding  the  Data  Link  program  and  the  design  of  the  four  Air 
Traffic  Control  (ATC)  services  that  were  investigated: 

a.  In  agreement  with  the  results  of  Mini  Study  1,  the  Data  Link  system 
continued  to  be  perceived  by  the  subject  controllers  as  an  extremely 
positive  enhancement  to  the  ATC  system.  Working  with  more  realistic  air 
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traffic  problems  than  those  presented  in  Mini  Stucfy  1,  the  controllers 
ccaicurred  that  the  iirplementation  of  <^rcpriately  configured  versions  of 
the  tested  services  and  functicais  will  significantly  reduce  radio 
frequency  (RF)  congestion  vAule  increasing  system  capacity,  safety,  and 
efficiency. 

b.  Ihe  conclusions  of  Mini  Stucfy  1  were  upheld  by  the  present 
results.  -Uie  test  subjects  continued  to  support  the  use  of  centralized 
plan  view  displays  (EVD)  of  Data  Link  transaction  status,  the  use  of  Data 
Link  without  redundant  voice  ccranunication,  the  necessity  for  downlinked 
confirmatory  responses  from  pilots,  and  the  use  of  autcroatic  uplinks, 
viiere  feasible,  to  minimize  data  entries. 

c.  Within  the  context  of  the  A3C  test  scenarios  enployed  in  this 
study,  perceived  controller  workload  was  unaffected  ly  the  substitution  of 
Data  Link  procedures  for  current  voice  procedures.  However,  because  of 
the  limited  task  demands  associated  with  the  test  scenarios,  this  finding 
will  require  confirmation  in  operatioml  evaluation  research  using  more 
complex  air  traffic  problems  and  greater  traffic  densities. 

d.  Controller  workload  was  not  significantly  affected  by  Data  Link 
time  delays  attributable  to  antenna  rotation  lag,  a  10  percent  rate  of 
iplink  failures,  or  the  simulation  of  an  ATC  environment  in  vrfiioh  only  a 
fraction  of  tlie  aircraft  were  equipped  with  Data  Link.  However,  because 
of  the  limited  ccnplexity  of  the  test  scenarios  and  an  apparent,  but 
nonsignificant,  trend  toward  increased  workload  when  cdl  three  of  these 
operational  conditions  were  simulated  together,  this  finding  edso  will 
require  confirmation  during  cperationed  evaluation  studies. 

e.  Ihe  design  configuration  for  transfer  of  communication  tested  in 
this  Mini  Study  produced  the  lowest  projected  workload  ratings  of  the 
tested  services  and  was  hi^ily  preferred  ty  the  test  subjects.  The 
results  edso  indicated  that  the  primary  flaw  in  the  tested  configuration 
was  that  the  transfer  of  iplink  authority  occurred  upon  aoc^Jtance  of  a 
hand-off  rather  than  after  the  transfer  of  ccramunication  had  been 
completed. 

f.  The  results  for  ciltitude  assignment  indicated  that  this  service 
cannot  be  implemented  in  fixed  automatic  iplink  mode.  While  autonatic 
iplinks  would  be  acceptable  for  a  majority  of  cases,  air  traffic 
situations  presented  in  the  test  sceneurios  revealed  that  an  acceptable 
version  of  this  service  must  permit  the  controller  to  selectively  inhibit 
uplinks  and  control  the  destination  for  any  altitude  data  entry  (e.g. , 
ipdate  NAS,  ipdate  full  data  block  (FDB),  or  both) . 

g.  The  menu  text  function  was  hi^ily  rated  by  the  subject  controllers 
and  was  perceived  as  a  preferred  method  for  issuing  repetitive  control 
clearances  common  to  a  specific  en  route  sector.  Because  of  this  primary 
aiplication,  the  controllers  indicated  that  the  function  should  be 
modified  to  couple  menu  iplinks  to  the  remainder  of  the  ATC  system.  The 
lack  of  this  provision  in  the  current  study  required  additional  data 
entries  to  ipdate  NAS,  and  negatively  impacted  projected  workload  ratings. 


h.  The  subjec±s  indicated  that  free  text  would  be  rest  suitable  as  a 
badap  to  radio  oantniinications  and  as  a  method  for  transmitting  non- 
ocxitrol  messages  emd  eidvisories.  Increased  meudmum  message  length  and  the 
ability  to  store  and  retrieve  free  text  messages  were  suggested  as 
enhancements  to  this  service. 

i.  Subject  ceaxems  about  transaction  display  clutter  and  reducing 
the  perceptual  demands  of  monitoring  Data  Link  activities  reinforced  the 
requirement  to  develop  FDB  di^lays  for  Data  Link.  Because  scroe  subjects 
preferred  more  ccmplete  transaction  informaticai  than  could  be  displayed  in 
the  FDB,  a  method  may  be  required  for  providing  both  minimal  transaction 
status  in  the  FDB  and  a  full  list  display  elsesAiere  on  the  PVD. 

j.  The  results  of  the  study  shewed  that,  althou^  simultaneous 
i;plinks,  NAS  tgidates,  and  FDB  v^xiates  are  preferable  in  many  situations. 
Arc  practices  reniire  that  it  be  possible  to  selectively  control  data 
entry  inputs.  One  approach  would  edlow  simultaneous  uplinks  and  system 
ipdates  as  a  default  cCTidition,  with  the  capability  to  inhibit  the 
autcroatic  iplink,  the  NAS  ipdate,  or  the  FDB  ipdate  by  adding  appn^riate 
prefix  codes  to  the  data  entry.  For  the  initial  package  of  Data  Link 
services,  such  a  modification  is  needed  primarily  for  altitude 
assignment,  but  may  be  required  as  a  general  feature  for  the  majority  of 
future  service  developments. 

5.  REXrWMENDATia^. 

The  results  and  conclusions  derived  frem  this  stuefy  formed  the  basis  for 
the  recommendaticaTs  listed  below.  These  reccramendations  are  intended  to 
guide  design  modifications  to  the  initial  package  of  Data  Link  air  traffic 
control  (ATC)  services,  and  to  identify  issues  relevant  to  the  conduct  of 
future  controller  evaluation  research  on  Data  Link  applications.  Ml 
recemmendations  should  be  considered  as  sipplements  to  those  recorded  in 
the  Mini  Study  l  r^»rt  (Talotta,  et  al.,  1988). 

a.  The  transfer  of  ccramunication  service  should  be  modified  to 
transfer  vplink  authority  to  the  receiving  controller  only  after  the 
transfer  of  oarammiication  has  been  caipleted  and  WILOOed  by  the  aircraft 
pilot. 


b.  The  ciltitude  eissignment  service  should  provide  for  a  choice  of 
both  automatic  and  manual  vplinks  by  service  delivery.  In  addition,  this 
service  must  provide  for  selective  control  of  updates  of  NAS  eind  the  full 
data  block  (FDB)  indication  of  assigned  altitudes. 

c.  In  order  to  make  menu  text  vjsable  for  the  delivery  of  primary 
control  instructions,  this  service  should  be  coipled  to  the  remainder  of 
the  ATC  system  so  that  vplinks  can  automatically  update  NAS,  the  FDB,  or 
both. 


d.  Free  text  should  be  enhanced  by  increasing  the  maximum  message 
length  and  by  providing  a  capability  to  store  and  retrieve  messages  for 
later  use. 
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e.  Bie  developnnent  of  FDB  displays  of  Data  Link  transac:±ion  status 
should  be  given  hi^  priority  in  the  further  refinement  of  the  initial 
service  package.  These  di^lays  should  be  designed  to  provide  an  eetsily 
interpreted  indication  of  key  transaction  states  (i.e. ,  SENT  and  FAII£D) , 
and  should  si^plement  rather  than  r^laoe  the  tran^ction  status  list. 

f.  Hi^  priority  eilso  should  be  assigned  to  the  development  of 
flexible  control  over  keyboard  and  tracddiall  data  entry  irputs. 
Provisicxis  should  be  itade  to  allow  selective  control  of  NAS  i^xiates,  FDB 
t^xiates,  and  i;plinks.  To  minimize  data  entry  requirements,  this 
modification  should  be  designed  with  default  destinations  covering  the 
majority  of  requirements  for  each  service. 

g.  In  order  to  identify  any  remaining  limitations  of  the  Data  Link 
service  designs  during  operational  evaluation  studies,  errphasis  should  be 
placed  on  the  development  of  ocnplex  ATC  scenarios  which  closely 
e^roximate  the  task  ciemands  experienced  ty  en  route  cxantrollers  in  field 
situations. 

h.  Riture  operatiancil  evaluation  research  should  include  a  further 
examinatic3n  of  the  impact:  c»i  controller  performance  and  workload  of  Data 
Link  tremsmission  delays,  vplink  failures,  and  mixed  eqciipage 
environments. 
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